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A method of volume visualisation 



Description 



Field of the invention 

The present invention relates to the field of volume visualisation, and more 
particularly without limitation to volume rendering. 

S Background and prior art 

Volumetric data is typically a set S of samples (x, y, z, v), representing the value 
v of some property of the data, at a 3D location (x, y, 2). If the value v is simply 
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a 0 or a 1 , e.g. with a value of 0 indicating background and a value of 1 
indicating the object, then the data is referred to as binary data. The data may 
instead be multivalued, with the value representing some measurable property 
of the data, including, for example, colour, density, heat or pressure. 

5 In general, samples may be taken at purely random locations in space, but in 
most cases the set S is structured, containing samples taken at regularly 
spaced intervals along three orthogonal axes. When spacing between samples 
along each axis is a constant, the set S is isotropic. If there are different spacing 
constants for the three axes, the set S is anisotropic. Since the set of samples is 
10 defined on a regular grid, a 3D array (called also volume buffer, cubic frame 
buffer, 3D raster) is typically used to store the values, with the element location 
indicating position of the sample on the grid. Alternatively, rectilinear, curvilinear 
(structured), or unstructured grids are employed. In a rectilinear grid the cells 
are axis-aligned, yet grid spacings along the axes might be arbitrary. 

15 Volume visualisation is a method of extracting meaningful information from 
volumetric data. Volume data are obtained by sampling, simulation, or 
modelling techniques. For example, a sequence of 2D slices obtained from 
magnetic resonance imaging (MRI) or computed tomography (CT) is 3D 
reconstructed into a volume model and visualised for diagnostic purposes or for 

20 planning of treatment or surgery. In many computational fields, as in fluid 

dynamics, the results of simulations typically running on a supercomputer are 
often visualised as volume data for analysis and verification. In addition, many 
traditional geometric computer graphics applications, such as CAD and 
simulation, as well as applications mixing geometric objects with medical data 

25 have exploited the advantages of volume techniques for visualisation. 

Volume rendering is the process of creating a 2D image directly from 3D 
volumetric data. Volume rendering can be achieved using an object-order, an 
image-order, or a domain-based technique. Object-order volume rendering 
techniques use a forward mapping scheme where the volume data is mapped 
30 onto the image plane. In image-order algorithms, a backward mapping scheme 
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is used where rays are cast from each pixel in the image plane through the 
volume data to determine the final pixel value. In a domain-based technique, 
spatial volume data is first transformed into an alternative domain, such as 
compression, frequency, and wavelet, and then a projection is generated 
5 directly from that domain. 

For an overview of various prior art volume rendering techniques reference is 
made to 'Handbook of medical imaging, processing and analysis', Isaac N. 
Bankman, Academic press 2000. 

An important field of application of volume visualisation techniques is medical 
10 imaging, such as imaging of MRI or CT image data. 

For example, the number of slices acquired in thorax CT scans is strongly 
increasing with advances in scanner technology. Current clinical scanners may 
produce more than 400 slices at resolution 512x512. Lab versions of scanners 
produce up to 2000 slices of size 1024x1024. The conventional way of looking 
IS at single axial slices for diagnostic purposes is very tedious, time consuming 
and error prone. Volume rendering techniques (VRT) are therefore increasingly 
popular in reading multi-slice thorax scans. 

Therefore a need exists for providing an improved method of volume 
visualization. 

20 Summary of the Invention 

The present invention provides a method of volume visualisation which enables 
to visualise an image region having a defined distance from a reference surface 
comprised in the image data. 

An important field of application of the present invention is medical imaging. For 
25 example an organ surface of a patient can be used as the reference surface. A 
user can interactively specify a desired distance from the reference surface. In 
response the voxels of the volumetric data having the specified distance from 



Erapf ansszei t 6 . MS r z 15:59 



4 



the reference surface are selected and visualised. This enables a radiologist to 
view surfaces in the volumetric data related to a selected reference surface. 

One of the advantages of using an organ surface or another anatomic or 
pathologic feature of the patient as a reference surface is that the patients 
5 anatomy itself provides the coordinate system for defining the image region to 
be rendered. For example anatomic features which are related to the surface of 
the organ can be visualised in an intuitive way. 

This is particularly advantageous for thorax imaging In order to identify 
suspicious regions. In thorax CT data the radiologist frequently has to identify 

10 dense nodules in the lungs parenchyma. These nodules, which are small 
regions suspicious for malignant tumors, are of particular importance. In the 
simplest case the nodules have isolated locations, but they occur frequently 
adjacent to the pleura or mediastinum, were they may also appear like a 
swelling of the surrounding tissue in the form of a lenticular or roundish plating 

1 5 of e.g. the pleura. The demarcation of tumor and healthy tissue is therefore 
based on very different contrasts in the diverse lung regions. 

With prior art rendering techniques such as thin-slab MIP ( Napel S, Rubin GD, 
Jeffrey RB Jr., STS-MIP: a new reconstruction technique for CT of the chest. J. 
Comput. Assist. Tomogr. 17(5):832-8 Sep-Oct 1993; Eibel R t Turk TR, Kulinna 

20 C , et ah: Multidetector-row CT of the lungs: Multiplanar reconstructions and 
maximum intensity projections for the detection of pulmonary nodules. Rofo. 
Fortschr. Geb. Rontgenstr. Neuen Bildgeb. Verfahr. 173(9): 8 15-21, Sep 2001.) 
even large tumors in the hilus region may be overlooked between the main lung 
vessels or their boundary may not be well defined. Even with the recently 

25 introduced techniques diagnosing of medical images using prior art rendering 
techniques takes a lot of time and is tedious.. Reading thorax data in the 
conventional way by going through the individual slices or with thin-slab MIP in 
addition has the implied risk of overlooking suspicious regions. 

In contrast, the present invention enables to visualise these images in an 
30 intuitive and easy to interpret way. This is due to the fact that the patient's 
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anatomy is used as a reference for defining the image region to be visualised. 
Further the anatomy tends to be almost homogeneous near prominent inner 
surfaces in the body. Thus the invention enables to produce images which show 
almost homogenous naturally curved layers of the body, wherein a pathology is 
5 easily noticed. 

It is to be noted that the present invention is not restricted to the particular type 
of thorax CT image data, but can be used in various different fields, such as 
visualisation of volumetric data provided by e.g. MRI, CT or 3D ultrasound 
scans of various body parts in medicine or outside the medical field to data from 
10 3D microscopy, 3D geologic data, weather data, fluid dynamics simulations etc. 

In accordance with a preferred embodiment of the invention, an image 
segmentation is performed on the original volumetric data. By means of the 
segmentation, a certain object is identified in the volumetric data. An envelope 
of the object is then used as a reference surface. 

15 Segmentation methods are as such known from the prior art. In particular, 
segmentation is an important tool in medical image processing. By means of 
segmentation an image is partitioned into regions that are homogeneous with 
respect to one or more characteristics or features. Known segmentation 
techniques include pixel-based local methods, region-based global methods, 

20 low-level segmentation (threshholding, region growing , watershed transform, 
etc), model-based segmentation (multispectral or feature map techniques), 
dynamic programming, contour flowing etc., statistical, fuzzy and neural network 
techniques to name a few. For an overview of prior art medical image 
segmentation methods reference is made to 'Handbook of medical imaging, 

25 processing and analysis', Isaac N Bankman, Academic Press 2000, in particular 
chapter II. 5. 

For example, an organ can be segmented from the volumetric data. This 
segmentation provides an indication of which ones of the voxels contained in 
the volumetric data belong to the organ and which ones do not. By taking only 
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those voxels of the organ that have neighbouring voxels not belonging to the 
organ the organ surface can be defined. 

The organ surface is used as a reference surface for selecting voxels of the 
volumetric data being equidistant to that reference surface. This way an inner 
5 layer of the organ being parallel to the organ surface or an outer layer 
surrounding the organ in parallel to the organ surface can be visualised. This is 
especially useful for identification of suspicious regions, such as tumours near 
the surface, or for an example employing an outer layer, to provide a view of all 
ribs surrounding the lung in one image for the task of diagnosing rib fractures. 

10 Various distance measures can be used for selecting the voxels which are 
equidistant from the reference surface. For example the distance of a given 
voxel from the reference surface can be measured along the grid of the 3D 
image array. Alternatively the Euclidian shortest distance of the voxel from the 
reference surface can be calculated as a distance measure. 

15 For computation of the Euclidean distances, the multi-dimensional distance 
transform algorithm for digitised Images which is as such known from T Saito 
and J.-l Toriwaki, "New algorithms for Euclidean distance transformation of an 
n-dimensional digitised picture with applications," Pattern Recognition 27, pp. 
1551-1565, 1994 can be utilised. 

20 Alternatively the distance can be measured along the projection ray of 
perspective projection or a more general distance measure, e.g. such as by 
means of a potential field calculus. 

The resulting set of equidistant voxels can be visualised by means of any 
suitable visualisation method, such as by orthogonal projection, perspective 
25 projection, and/or volume rendering techniques. 

In accordance with a further preferred embodiment of the invention a computer 
system is provided having a user interface for interactive selection of a desired 
distance. This way a user is enabled to interactively navigate through a given 
body region by using the surface of an organ as a reference for the navigation. 
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This is especially useful for diagnostic purposes and operation planning. 
Likewise such a computer system can also be used for interactive visualisation 
of other three or more dimensional data, such as 3D microscopy data, weather 
data, geologic data, or data describing a biological technical, physical or 
5 chemical process. 

Brief description of the drawings 

In the following preferred embodiments of the invention will be described in 
greater detail by making reference to the drawings in which: 

Figure 1 is illustrative of a flow chart for the visualisation of volumetric 

10 data, 

Figure 2 is a simplified schematic showing a two dimensional slice of the 

volumetric data comprising a reference surface, 

Figure 3 shows the example of figure 2 after an orthogonal projection, 

Figure 4 shows a block diagram of a computer system. 

15 Detailed Description 

Figure 1 shows a flow chart of a method for visualising of volumetric data- In 
step 100 a volumetric data acquisition is performed. For example, in the case of 
medical data this can be done by means of CT or MR data acquisition. 
Alternatively 3D microscopy or any other image data source can be used. In 
20 general, any three or more dimensional data can be used as an input data set 
for the visualisation. 

In step 102 the segmentation of the volumetric data is performed. The 
segmentation can have the purpose of segmenting a particular anatomic region, 
such as an organ. Any known segmentation method can be used for this 
25 purpose. 
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For example the result of the segmentation is provided as a binary mask which 
identifies those voxels of the volumetric data belonging to the segmented 
structure, object or organ. The binary mask defines the envelope of the 
segmented structure. The surface of the segmented structure can be identified 
5 from the binary mask by any suitable prior art method, such as a morphological 
gradient method. 

Alternatively the segmentation performed in step 102 can directly provide the 
reference surface rather than a seg .. 

In step 104 the distances of the voxels of the volumetric data which are outside 
10 the reference surface to the reference surface are determined. For 

determination of the distances various distance measures can be used. For 
example, if orthogonal projection along one of the grid axis of the volumetric 
data set is used the distance of a voxel to the reference surface can be defined 
as the distance between the voxel and the reference surface along the 
1 5 projection ray going through that voxel. 

Alternatively a minimum distance of the voxel from the reference surface can be 
determined. In this case the Euclidian distance measure is a good choice. The 
result of the distance determination performed in step 104 can be provided as a 
distance map having the same dimension as the volumetric data set and having 
20 a distance measure for each one of the voxels of the volumetric data, except for 
the voxels on the reference surface, where the distance is 0 by definition. 

In step 106 a user enters a desired distance. For example the distance can be 
specified as a number of voxels or in length units, such as millimeters. 

In step 108 the distance map provided in step 104 is searched for identification 
25 of voxels having the user selected distance from the reference surface. The 
result of this identification step can be provided by a binary mask having the 
same dimension as the volumetric data set and which indicates for each one of 
the voxels of the volumetric data set whether it is at the selected distance from 
the reference surface or not 
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Alternatively the selection of voxels at the specified distance can be implicit in a 
reformatting of the data prior to a projection, or the selection may be integrated 
in the rules determining the opaqueness of voxels in a volume rendering 
software. 

5 The distance mask can be used as a basis for performing a projection of the 
equidistant voxels in step 110. For example, an orthogonal, perspective or other 
kind of projection is performed or another volume rendering technique is applied 
on the voxels identified by the distance, mask in order to generate a display in 
step 112. From there the control can go back to step 106. In step 106 the user 
10 can enter another distance in order to navigate through the volumetric data 
using the segmented surface as a reference. 

Figure 2 is illustrative of a schematic example. Figure 2 shows a two 
dimensional slice 200 of a volumetric data set. Within slice 200 there are voxels 
202, 204, 206, 208, 210, ... which belong to an image region which has been 
IS segmented from the volumetric data. For example the image region is an 
organ. These voxels 202 to 210 define the reference surface for the volume 
visualisation. 

As a pre-processing step before the volume visualisation the distances of all 
voxels Vj Vj outside the segmented reference surface to the reference surface 
20 are determined. 

For example, if an orthogonal projection along the grid of the volumetric data set 
is used, such as in direction 212 the distance between voxel Vj and the 
reference surface can be measured along the corresponding projection ray of 
the orthogonal projection. In the example shown in figure 2 this is the distance 
25 214 between the voxel Vj and voxel 202 of the reference surface. 

For voxel Vj this is the distance 216 to voxel 208 of the reference surface and 
so on. Preferably the distances 214, 216, ... are determined for all voxels V if Vj, 
... which do not belong to the reference surface defined by voxels 202, 204, 
206,208,210,... 
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As an alternative distance measure minimal distances of the voxels V if Vj, ... 
from the reference surface are determined. For example distance 218 is the 
minimum Euclidian distance of voxel V t to the reference surface, i.e. voxel 204. 
Likewise distance 220 is the minimum Euclidian distance of voxel Vj from the 
reference surface, i.e. voxel 210. Again it is preferred to determine all the 
distances 218, 220, ... for all voxels outside the reference surface as a pre- 
processing for the volume visualisation. 

Next a user can select a desired distance and those voxels of the volumetric 
data set which have a distance from the reference surface corresponding to the 
user selected distance are shown in the visualisation. 

Alternatively a reformatting step is performed on the volumetric data as a further 
pre-processing step. The principle of the reformatting operation is illustrated in 
figure 3. All voxels 202 to 210 of the reference surface are moved to common 
row r s of slice 200. The voxels which are outside the reference surface are also 
moved within slice 200 such that the respective distances from the reference 
surface remain the same. In other words a voxel V, is moved to row r n from its 
original row r m by a number of rows m - n such that its distance 214 (cf. figure 
2) from the reference plane remains the same. The same principle applies for 
the other voxels outside the reference surface, namely voxel Vj. 

As a result all voxels which are equidistant to the reference surface are moved 
into a common row. 

On the basis of this reformatted volumetric data set it is possible to visualise 
slices containing curved layers of anatomy. For this purpose an image is 
generated for the voxels within a common row of slice 200 and the voxels in the 
same row positions in parallel slices. This way a radiologist can step through 
layers which are parallel to the reference surface which provides an intuitive 
view on anatomic information, especially for diagnostic purposes. 
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Figure 4 shows a computer system 400 which is coupled to an image data 
acquisition system 402. For example image data acquisition system 402 is a CT 
or MR apparatus providing medical volumetric data. 

Computer system 400 has image storage 404 for storing of a volumetric data 
set 406 provided by image data acquisition system 402. 

Further computer system 400 has segmentation program 408. Segmentation 
program 408 serves to identify a region of interest within volumetric data set 
406, such as an organ or another anatomic region. Segmentation program 408 
provides binary mask 410 having the same dimension as volumetric data set 
406. A value of 0 in the mask 410 indicates that the corresponding voxel in 
volumetric data set 406 does not belong to the region of interest whereas a 
value of 1 indicates that the corresponding voxel belongs to the region of 
interest. As a consequence mask 410 also describes the envelope of the 
segmented region of interest. The envelope is used as a reference surface for 
identification of equidistant voxels in the volumetric data set 406. 

Alternatively segmentation program 408 directly extracts the reference surface 
from the volumetric data set rather then segmenting an organ as an 
intermediate processing step. 

Further computer system 400 has program 412 for providing a distance map 
414. Distance map 414 has the same dimension as volumetric data set 406. 
Each value in distance map 414 indicates the distance of the corresponding 
voxel of volumetric data set 406 to the reference surface which is identified by 
mask 410. For example program 412 calculates the shortest distance of each 
voxel of volumetric data set 406 to the reference surface. The distances can be 
calculated as Euclidian distances or by means of a general mathematical 
distance measure, such as a potential field distance calculus. 

When a user has selected a desired view a transparency value is calculated for 
each voxel depending on the distance of that voxel which is stored in the 
distance map 414. 
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Further computer system 400 has user interface 416. By means of user 
interface 416 a user can interactively navigate through layers which are parallel 
to the reference surface. This can be done by imputing of a desired distance of 
the layer to be visualised or by means of a graphical user interface such as by 
moving a mouse pointer or by rotating a mouse wheel. For example a 
radiologist can select the distance of the layer to be visualised from the 
reference surface by the amount of rotation of the wheel of a wheel mouse. 
Alternatively or in addition a graphical user interface with a virtual slider is 
provided; in this instance the radiologist can select the distance by moving the 
slider to a corresponding position. 

Volume rendering program 418 serves to generate bit-mapped image data for 
frame buffer 420 for the visualisation of the voxels having the selected distance 
from the reference surface. These voxels are selected from the distance map 
414 using the desired distance which has been entered by the user as a key. 
Alternatively the bit-map image is generated by modifying the transparency 
values which are assigned to the voxels depending on the selected distance 
from the reference plane. 

A monitor 422 is coupled to frame buffer 420 for display of the bit-mapped 
image. 
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List of reference numerals 



200 slice 

202 voxel 

204 voxel 

206 voxel 

208 voxel 

210 voxel 

212 direction 

214 distance 

216 distance 

218 distance 

220 distance 

400 computer system 

402 image data acquisition system 

404 image storage 

406 volumetric data set 

408 segmentation program 

410 mask 

412 program 

4*14 distance map 

416 user interface 

418 rendering program 

420 frame buffer 

422 monitor 
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CLAIMS 



A method of volume visualisation comprising: 

- providing of volumetric data, the volumetric data having first voxels 
belonging to a reference surface, 

- determining of second voxels of the volumetric data having a user 
selected distance from the reference surface, 

- visualising of the second voxels. 

The method of claim 1 further comprising performing a segmentation of 
the volumetric data to identify the first voxels. 

The method of claim 1 or 2, the distance of each one of the second 
voxels from the reference plane being determined along a direction of 
projection. 

The method of claim 1, 2 or 3, the distance of each one of the second 
voxels from the reference surface being determined by a minimum 
distance measure. 

The method of claim 4, the distance measure being an Euclidean 
distance. 

The method of any one of the preceding claims 1 to 5, whereby the 
volumetric data is medical image data, e. g. a thorax CT scan to be 
diagnosed e.g. for lung nodules, other lung diseases or rib fractures, and 
the reference surface is the surface of a body region, such as the surface 
of an organ, e.g. the lungs surface, or a pathological structure. 
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7. The method of any one of the preceding claims 1 to 6, the volumetric 
data being three dimensional microscopy data. 

8. A computer program product, such as a digital storage medium, for 
volume visualisation, comprising program means for performing the 
steps of: 

- providing of volumetric data, the volumetric data having first voxels 
belonging to a reference surface, 

- determining of second voxels of the volumetric data having a user 
selected distance from the reference surface, 

- visualising of the second voxels. 

9. The computer program product of claim 8, the program means being 
adapted to perform a segmentation of the volumetric data to identify the 
first voxels. 

10. A computer system for volume visualisation, comprising: 

- means (404) for storing of volumetric data (406), the volumetric data 
having first voxels (410) belonging to a reference surface, 

- means (412, 414) for determining of second voxels of the volumetric 
data having a user selected distance from the reference surface, 

- means (41 8, 420, 422) for visualising of the second voxels. 

11. The computer system of claim 10, further comprising means (408) for 
segmentation of the volumetric data to identify the first voxels. 

1 2. The computer system of claims 1 0 or 1 1 , further comprising user 

interface means (416) for entering of the user selected distance, the user 
interface means preferably comprising a wheel mouse or virtual slider, 
the amount of rotation of the wheel of the wheel mouse respectively the 
slider position being indicative of the user selected distance. 
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13. The computer system of claims 10, 1 1 or 12, further comprising means 
(418) for volume rendering of the second voxels. 
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Abstract 



A method of volume visualisation 



5 The present invention relates to a method of volume visualisation comprising: 

- providing of volumetric data, the volumetric data having first voxels 
belonging to a reference surface, 

- determining of second voxels of the volumetric data having a user 
selected distance from the reference surface, 

10 - visualising of the second voxels. 



(Figure 1 ) 
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Volumetric Data Acquisition 
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Segmentation to provide reference surface 
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Determination of distances of voxels to reference surface 
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Input: User selected distance 
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Identification of voxels having the user selected distance from reference surface *40 t 
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